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We present upper and lower bounds for the tail distribution of the stationary waiting time D in the stable 
GI/GI/s FCFS queue. These bounds depend on the value of the traffic load p which is the ratio of mean service 
and mean interarrival times. For service times with intermediate regularly varying tail distribution the bounds 
are exact up to a constant, and we are able to establish a "principle of s — k big jumps" in this case (here k is 
the integer part of p), which gives the most probable way for the stationary waiting time to be large . 

Another corollary of the bounds obtained is to provide a new proof of necessity and sufficiency of conditions for 
the existence of moments of the stationary waiting time. 
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1. Introduction and main results. We consider a first-come-first-served multi-server system with 
s identical servers. Let r be a typical interarrival time and a a typical service time. Independent 
identically distributed sequences of interarrival times {t„} with mean a = Er and service times {o~ n } 
with mean b = Ecr are assumed to be mutually independent. We also assume throughout the paper that 
the distribution of a has unbounded support, i.e. B(x) :— P{er < x} < 1 for all x, and that the system 
is stable, i.e. p := b/a < s. 

There are two equivalent ways to describe the dynamics of a multi-server system. First, we may assume 
that customers form a single queue in front of all servers, and that the first customer in the queue moves 
immediately to a server which becomes idle. Second, we may assume that customers form s individual 
queues (lines) - one queue for each server, service times of customers become known upon their arrival, 
and each arriving customer is directed to the line with a minimal total workload (we also assume that 
queues are numbered, and if there are more than one minimal workloads, then a customer chooses the 
one with the minimal number). In the rest of the paper, we mostly follow the second description of the 
model. 

For n = 1, 2, . . . , let V„ = (V n i, . . . , V ns ) be the vector of residual workloads in lines 1, . . . , s which 
are observed by the n-th customer upon its arrival into the system. The value of D n :— mm{V n j,j < s} 
is the waiting time, or the delay which customer n experiences. The n-th customer joins the i ra -th line. 
Then 

in = min{i : V m = D n } 



and 



V, 



n+l,z 



(Vni + c„ - t„ +1 )+ ifi = i n , 
(V m -T n+1 ) + if i^i n . 



Let R(w) — (i?i(w), . . . , R s (w)) be the operator on M. s which orders the coordinates of w S IR S in the 
non-descending order, i.e., i?i(w) < • • • < R s (w). For n — 1, 2, ... , put W„ = KV n . Then D n = W n \ 
and the vectors {W ra } satisfy the Kiefer-Wolfowitz [11] recursion: 

W„ +1 = R((W nl + a n - 7W+i)+ (W n2 - T„+i) + , . . . , (W ns - T n+1 ) + ). (1) 

In a stable system, there exists a unique stationary distribution for the Kiefer-Wolfowitz vectors W n , 
and the distribution of W„ converges to the stationary distribution in the total variation norm, as n — > oo. 
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In particular, the same holds for the D n : there exists a unique distribution of the stationary waiting time 
(delay) D, and the distribution of D n converges to that of D in the total variation norm. 

In a single server queue (s = 1), the waiting times D n satisfy the Lindley recursion |13j : 

Dn+l = {Dn + &n — T n +l) + ■ 

Recall that, given D\ = 0, D n+ \ coincides in distribution with max(5fe,fe < n) where So = and 
S n = X)fe=i( (7 'i; — T k+i), for n > 1. It is well known (see, for example, [331 HH1 I]) that the tail of 
stationary waiting time D is related to the service time distribution tail B(x) = P{cr > x} via the 
equivalence 

P{D > x} ~ —?—Br(x) as x -> oo, (2) 
1 ~ P 

provided the suhexponentiality of the residual service time distribution B r defined by its tail 

— 1 f°° — 

B r (x) := - J B(y)dy, x>0 

is guaranteed. Recall that a distribution G on R + is subexponential, G € S, if G * G(x) ~ 2G(x) as 
x — > oo. 

It is also well-known that, in a single server queue, for any 7 > 0, D has a finite 7th moment, ED 7 < 00 
if and only if Ecr 7+1 < 00, see [T2]. Equivalently, EZ? 7 < 00 if and only if 

Ecr^i < 00 
where random variable a r l has distribution B r . 

Less is known about the stationary delay D in the multi-server queue. It is well understood that 
the heaviness of the stationary waiting time tail distribution depends substantially on the load p on the 
system (see, for example, the conjecture on tail equivalence by Whitt in |20j : existence results for moments 
in [HI HH [TT1 [18]; asymptotic results for fluid queues fed by heavy-tailed on-off flows in j4j [5]). More 
precisely, the tail distribution depends on p via the value of its integer part k — [p] £ {0, 1, . . . , s — 1}. 

For a GI/GI/s system, a heuristic idea on a probable way for the large deviations to occur may be 
described as follows. Take N — x b ^ ka , for a very large x. Let all service times ovi-jv-s+fc, ■ • ■ , cr n _jv-i 
be big enough, say <J n -N-i > x + Na, i = 1, . . . , s — k. Then the other k servers form an unstable 
GI/GI/k queue system, because the cumulative drift of the corresponding workloads approximately 
equals b — ka > 0. In time N all workloads of these queues will exceed level x (again approximately). 
In this way, at time N, all s workloads become greater than x with probability which is asymptotically 
not less than B"~ (x + Na) « (x-^) =B (x-^). We use these heuristic arguments below in 
Section [5] to derive a lower bound. We follow more precise calculations to obtain a better lower bound of 
order Z?* (x-^). 

We recall now a few basic properties of heavy-tailed distributions and relations between them. A 
distribution function F is 

• long-tailed, F e C, if F(x + 1) ~ F(x), as x — > 00; 

• dominated varying, F 6 T>, if F(2x) > cF(x), for some c > and for all x; 

• intermediate regularly varying, F G 21ZV, if 

limliminf F(x(l + e))/F(x) = 1; 

eiO x->co 

• regularly varying, F 6 1ZV, if F(x) — l(x)x~ a for x > where a > is the index of regular 
variation and l(x) is a slowly varying at infinity function, i.e. l(cx) ~ l(x) as x — >• 00. 

The following relations are known: 

KV C 1KV cCHVcS, (3) 

see e.g. [10], pp. 33 and 54. 

In [9], we treated the case s = 2 in detail and found the exact asymptotics for ¥{D > x}. We 
also described the most probable way for the occurrence of the large deviations. That means that, for 



S. Foss and D. Korshunov: Multi-Server Systems with Heavy Tails 
Mathematics of Operations Research xx(x), pp. xxx-xxx, (c)200x INFORMS 



3 



the stationary waiting time to be large, two large service times have to be large if p < 1 and B r is a 
subexponential distribution (see j£l Theorem 1]) and one service time has to be large if 1 < p < 2 and if 
B is long-tailed and B r is intermediate regularly varying (see [9J Theorem 2]). We also obtained a number 
of simple bounds. First, Theorem 1 in [5] yields the following 

Theorem 1.1 Let s = 2, p < 1, and let the residual time distribution B r be subexponential. Then the 
tail of the stationary waiting time satisfies the asymptotic relation, as x — > oo, 

o 2 r — f°° — — 

F{D>x} ~ (B r (x)) 2 + / BJx + ya)B(x + y(a - b))dy 

2-pL J 

As a corollary, one can obtain the following bounds for the stationary waiting time, as x — > oo: 
<p 2 {2 + p) - < ~ 2 



+ o(l))B 2 r (x) < P{D >x}< (^7^ + o(l))B 2 r (x). 



2(2 -p) "J r " 1 ~ V2(l-p) 

Another corollary is: if, in addition, the distribution B is regularly varying with index 7 > 1, then, as 
x — >• 00: 

F{D >x} - c(B r {x)) 2 , 

where 

p 2 r p f°° dz 



1 



2 -pi 7 -l J (1+ 2)7-1(1 + 2 (l-p))7 

For the case p > 1, we also proved in [9] 

Theorem 1.2 Let s = 2, 1 < p < 2, and let both B and B r be subexponential distributions. Then the 
tail of the stationary waiting time satisfies the following inequalities: 

P{D > x] p 
limsup^= < 



B r {2x) ~ 2-p 
and, for any fixed 8 > 0, 

. P{D > x} p 

hrnini =— — x - > . 

*-foo B r (f^x) ~ 2-p 

If, in particular, B is subexponential and B r is intermediate regularly varying, then 

P{D>x} - TT—Bri— ^—x) as x -too. 
2 — p \p — 1 / 

For an arbitrary s > 2 number of servers, the best result on the existence of moments was obtained in 
p~7l Theorem 4.1] (here Cj is a specific class of distributions introduced in [17 ): 

Theorem 1.3 Let k < p < k + 1 for some k 6 {0, 1, . . . , s — 1}. Then: 

(i) IfEaf < 00 then E J t>( s - fe )(^ 1 ) < 00. 

(ii) If in addition a is in the class Cj, then ED( s_fc )( 7 ~ 1 ) < 00 implies E5" 7 < 00. 

In the present paper we introduce a condition which is both necessary and sufficient for the finiteness 
of E£> 7 . We present this condition in "probabilistic terms" . 

Theorem 1.4 Let o~ r ,\, o- r ,i, ■■■ be independent random variables with common distribution B r . Let 
k < p < k + 1 for some k € {0, 1, . . . , s — 1}. For any 7 > 0, ED 7 is finite if and only if 

E(min(cr ri i,...,cr riS _A;)) 7 < 00, (4) 
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see Section [5] for the proof. Actually, this result (which is sharper than Theorem II. 3|) may be deduced 
from the results of |17j , but was not stated there. The corresponding proof in [17] involves a comparison 
with the so-called semi-cyclic service discipline. To the best of our knowledge, the latter approach does 
not allow one to obtain upper bounds for the tail distribution of D. 

The main aim of the present paper is to introduce a novel approach for constructing upper bounds for 
the stationary waiting time in multi-server queues (see Section[7]below). This allows us to derive estimates 
for the tail probabilities of the distribution of the stationary waiting time if the common distribution of 
service times is of supexponential type, and, further, to establish the principle of big jumps in a particular 
case of intermediate varying distributions. Also, based on the new approach, we will obtain a direct proof 
of Theorem ITU (see Section H]). 

The most explicit bounds are obtained for the case p < 1. 

Theorem 1.5 Let p = b/a < 1 and let the residual time distribution B r be subexponential. Then the tail 
distribution of the stationary waiting time admits the following bounds: 

4<liminf P g > ^ < limsup P ^ > ^<(^) S . 
s! x^oo B r (x) x^oo B r (x) \l-py 

We present here the lower and upper bounds only. As it was described in [9], the only case where 
the tail asymptotics are available with an explicit constant multiplier is the case of regularly varying 
service time distribution. The corresponding calculations are rather involved and deal with the law of 
large numbers and a summation over a specific s-dimensional domain with planar boundaries. These 
calculations have been carried out in [S] in the case of s = 2 servers. 

The proof of Theorem 11.51 (see Section [3]) is based on a simple argument which cannot be applied if 
p > 1. For an arbitrary p, we have the following result. 

Theorem 1.6 Let k E {0, . . . , s — 1} and 6 > 0. If p > k, then 

If p < k + I and if the residual service time distribution B r is subexponential, then 

P{D>x} < (I) {^~p + °W) * ^Wl - 5)) asx^^. 

The lower bound follows from Theorem 15. II in Section [SJ The proof of the upper bound may be found 
in Section [7J It is based on results from Section [SJ where we present a novel construction of a consistent 
major ant for D n . 

Note that the lower and the upper bounds in Theorem 11.61 are not necessarily of the same order. In 
particular, if distribution B is of Weibull type then the ratio of the upper and the lower bounds tends 
to infinity, as x increases. In this case we do not have any ideas about how correct /exact /sharp bounds 
would look like. But if, in particular, the residual service time distribution belongs to the class V n £, 
then these bounds differ by a multiplicative constant only. 

Note that in Theorem ll.6l we require conditions on the residual distribution B r and not on the distribion 
B itself. This is in line with the key results on subexponentiality like @. 

Corollary 1.1 Let the residual service time distribution B r be long-tailed and dominated varying. Let 
k < p < k + 1 for some k £ {0, 1, . . . , s — 1}. Then there exist constants c\ and C2 such that, for all x, 

Cl B s r r k {x) < P{D > x} < c 2 B s 7 r k {x). (5) 

The result follows directly from Theorem 11.61 the last inclusion in (J3|) and the definition of the domi- 
nated variation. 

In the particular case of distributions of intermediate variation, we will use [3l Theorem 7] to comple- 
ment Corollary 1 1.1 1 by establishing the "principle of s — k big jumps": the main cause of the value of D 
to be big is to have s — k big service times, see Section [7] for the precise statement. 
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2. Comparison of systems with different inter-arrival times. Here we present results which, 
in particular, allow us to obtain lower and upper bounds for the stationary delay in a general GI/GI/s 
system in terms of a simpler D/GI/s system with deterministic interarrival times. We use the following 
partial ordering: for two vectors x = (x\, . . . , x s ) and y = (yi, . . . , y s ), we write x < y if Xj < yj for all 
j = 1, s. 

Consider two GI/GI/s systems, say V and V, with service times o~ n and with interarrival times r„ and 
T n respectively Let D n and D n be the corresponding waiting times in these systems. Let £ n = r, i+ i — t„ + i. 
We obtain an upper bound for delay D n in terms of delay D n and the sequence £„. 

Lemma 2.1 For all n > 1, D n < D n + M n -\, where M = and M„ = (M n -i + 6) + - 

Proof. Put ei = (1,0,..., 0) and 1 = (1, . . . , 1). It suffices to prove the inequality 

W„ < W„ + 1M„_! a.s. (6) 

We proceed by induction. For n = 1 we have < + IMq. Assume inequality ([6]) to hold for some n 
and prove it for n + 1 . We have 

W n+ i = R(W n + eicr„ - lf n+ i) + 

< R(W n + 1M„_i + exa n - lr n+1 )+ 

= R(W n + Bia n - l? n+1 + l(M n _i + £„))+. 

Since {u + v) + < u + + v + , 

W n+1 < R(W n + e 1( r„ - lf„+i)+ + l(M n _i + 60+ = W„ +1 + 1M„, 
and the proof of (0 is complete. □ 
The following corollary will be used to obtain lower bounds. It is similar to Lemma 2 in [9]. 

Corollary 2.1 Let W n be a stable s-server queue system with the same service times a n as in W„ and 
with the constant interarrival times a' . If a' > a = Et, then, for any e > 0, there exists xq such that 

P{D>x} > (1 -e)¥{D' > x + xq} for all x. 

One can take Xq such that 

n 

Pjsup V(r, - a') < x \ > 1 - e. 

— i— 1 

Proof. Take r n = a' and t„ = t„ in Lemma I2TT1 then £ n = r n — a'. A weak limit, M, of the sequence 
M n exists (since E£i = a — a' < 0) and has the same distribution as 

M = st max{0, f x , 6+6, • • ■ , & + ••• + 6, • • •}• 

By Lemma [2TT1 D' n < D n + M n -\. Hence, D n > D' n — M n -i Since D' n does not depend on r's, D' n and 
A/„_i are independent. Therefore, 

¥{D n > x} > P{M n _i < x Q }P{D' n >x + x }. 

Letting n go to infinity, we obtain the desired bound. □ 

3. The case p < 1, proof of Theorem ll.5l The lower bound in Theorem 11.51 follows from Lemma 
13.11 below which also generalises Theorem 15. II (see Section [S]) in the case k = 0. 

Lemma 3.1 Let p > 0. Then, for any function h(x) — > oo as x — > oo, 

P{D >x}> pS + ° {l) B~ r s {x + h(xj). 
s\ 

In particular, if the residual time distribution B r is long-tailed (that is, B r {x + 1) ~ B r (x) as x —> oo), 
then 

¥{D >x}> P + °^ B^ s (x) as x oo. 
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We start with an auxiliary result. 
Lemma 3.2 Let {<2j}i>i be a non-increasing sequence of positive numbers. Then, for any s > 1, 

^2 *i ■■■•■Us > -](<ls + q s +i + ■ ■ -Y- 



s< 

l<i 1 <...<i 3 



PROOF. If 1 < i\ < . . . < i s then s < i\ + (s — 1) < i% + (s — 2) < . . . < i s _i + 1 < i s and 

In ■ Qi 2 ' ■ ■ ■ ' ii s > Qii+s-l ■ Qi 2 +s-2 ■ ■ ■ ■ qi s , 

because {q{\ is a non- increasing sequence. Thus, 

X] In ■ ■ ■ ■ ■ Us > In' ■■■■ lis 

Kii<...<i s s<ii<...<i s 



which yields the conclusion of the lemma. □ 

Proof of Lemma [3. 11 Our estimation is based on calculations involving s big jumps. This technique 
was already used in [9] in the case s = 2, where a lower bound (which is better than the one presented 
in Lemma l3.1[) was obtained under the extra condition that B r is long-tailed. The bound in [9] is exact 
in the sense that it provides the right asymptotics under further assumptions. 

Following Corollarv l2.1[ define the auxiliary s-server system having the same service times a n and 
constant interarrival times a', a' > a. For i = (ii, . . . , i s ), 1 < i\ < . . . < i s < n, define events A n (i) and 
C n (i) as 

A n (i) = {a h > x + (n - ii)a' , . . . ,a is > x + (n - i s )a'} 

and 

C n (i) = P| {a, < x+ (n-i)a'}. 

i<n^i^ii ,...,i s 

Since the mean Ea exists, we have that, uniformly in n and i, 

oo 

P{C„(i)} = 1 - P{C„(i)} > 1 -^>{cri > x + ia'} 1 as x oo. 

i=0 

For each vector i, events A n (i) and C„(i) are independent. Further, events A n (i) n C n (i) are disjoint for 
distinct vectors i. These observations together yield 

p{U4>(i)nC n (i)} = ^P{A n (i)}P{C n (i)}>(l-o(l))^P{A n (i)} (7) 

i i i 

as x —> oo, uniformly in n. The event A n (i) implies that D' n > x. Therefore, 

P{D' n >x} > (l- (l))^PLA„(i)} 

i 

as x — y oo, uniformly in n. We now prove that 

lim Y P{A n (i)} > ^L^ix + sa'). (8) 

n— >oc * — ' si 
i 

Indeed, by the independence of the cr's, 

J2 p {^n(i)} = B{x + (n- h)o!) -....B(x+( 

l<ii < . . .<i s <n l<ii<...,i s <n 

and the left side of ([5]) equals 

B(x + iia') ■ ... -B(x + i s a'). 

Kii<...<i s 



ii - i s )a'), 
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By Lemma 13.21 with qi = B(x + ia!), the latter sum is not smaller than 

-{^B{x+ja')) S . 
Since the tail probability is a non-increasing function, 

00 ^ poo 

~^^B(x + ja!) > — / B(x + z)dz — pB r (x + sa'). 

j=s a J sa ' 

Combining altogether, we conclude ([5]). Then by Corollary 12. 11 for every e > there exists xq such that 
P{D>x} > (1 -e)F{D' > x + x } 

> (1 - e - o(l)) ^ ^ B~ r \x + sa' + x ). 
s\ 

By the arbitrary choice of a' > a and e > 0, the proof of Lemma \3. II is complete. □ 



Proof of the upper bound in Theorem 11.51 We start with the case of deterministic r, i.e., 
T n = a. We follow the lines from [S] where, for p < 1 (that is for b < a), the following simple majorant 
was introduced. 

Let <7„i, n > 1, i < s, be independent random variables with common distribution B. Consider s 
auxiliary D/GI/l queueing systems which work in parallel: at every time instant T n = na, n = 1, 2, . . . , 
a batch of s customers arrives, one customer per each queue. Service times in queue i are equal to a n i. 
Denote by U n i, i — 1, . . . , s, the waiting times in the iih queue, U n +i.i — (U n i + a n i — a) + , and let Uu = 0. 
Since the arrival process is deterministic and service times are independent, vector (U„i, . . . , U ns ) has 
independent identically distributed coordinates, and, as n —> 00, its weak limit (Ui, . . . , U s ) exists (since 
Ecr < a) and contains independent identically distributed coordinates too. Here Ui is the stationary 
waiting time in the ith auxiliary queue. 

Now we introduce a coupling of s single-server systems and of the s-server system D/GI/s. Namely, 
we determine the service times a n in the original D/GI/s system by induction. Start with o\ — <J\^\. 
Assume that a%, . . . , (J n ~i have been already defined. Then the delay vectors Vi, . . . , V„ are defined 
too, and we know the number i n = min{i : V n i = D n }. Then let a n = <r„ 



/J :l n 



By monotonicity, D n < min{[/„i, i < s} with probability 1. Hence, 

D < mm{U t , i < s}. (9) 

Due to independence, 

P{D > x} < P s {C/i > x}, 
and we can apply known results for the single server queue: from (|2|), 

F{Ux > x} ~ -?—Br(x), 
1 - P 



which gives us the upper bound in Theorem 1 1.5 1 if interarrival times are deterministic. Now the proof in 
the general case follows from [9J Lemma 1]. □ 



4. Auxiliary results. In this Section we collect a number of auxiliary facts related to monotonicity 
and to the strong law of large numbers for unstable multi-server systems. The results seem not to be 
new, so we provide only short sketches of proofs for self-containedness. 

Let W„ be a sequence satisfying the Kiefer-Wolfowitz recursion (JlJ, with initial value Wi > 0. 

Lemma 4.1 (1) For any n, W„ is a non- decreasing function of the initial value and of service times and 
a non-increasing function of interarrival times^ This means that if W„ is a sequence satisfying another 
Kiefer-Wolfowitz recursion with initial value Wi and with interarrival times {r„} and service times {cr n } 
and if~Wi < (coordinate-wise), o-j < Uj, and tj > Tj, for j = 1, ...,n— 1, then W„ < W„. 
(2) For any n > 2, the difference J2i=i(W n i — W n —i i) is a non-increasing function of the initial value 
Wi; i/Wi < Wi, then J2Ui(W m - W n . hi ) > Ei=i(^m - W n -i ti ). 
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The first monotonicity property holds because both operators R and max(0, ■) are monotone. The second 
property follows since function [x + y) + — x is non-increasing in x, for any fixed y. 

Lemma 4.2 Let b > sa, so the s-server system with workload vectors W n is unstable. Then, 

W n i b-sa W ns b-sa 

> ana > asn-> oo, (1U) 

n s n s 

both with probability 1 and in mean. 

PROOF. Note that, for any n = 1, 2, . . ., 

W n+ i, s - W n+ i,i < max(W M - Wi,i,<ti, . . .,a n ). (11) 

Indeed, if W ns - W nl > er„, then W n +i, s - W„ +M < W ns - W n i, and if W ns - W n \ < a n , then 
W n +i, s — Wn+i,i < o-ji, so the induction argument completes the proof of (fTTj). Next, 

max(Wi s - Wii,a±, . . . ,(T n )/n -> a.s. (12) 

because (Wi s — Wn)/n — > and, since Ecr is finite, events {cr^/fc > e} occur only finitely often, for any 
e > 0. 

Further, 

I s i n ' 1 

— > Wni > — > (o~j — ST3+1) — > b — sa > a.s., 

i=i j=i 

so liminf„_ i . 00 W ns /n > (b — sa)/s, and, from (jll [) - f)l 2[) . there exists an a.s. finite random variable v such 
that W n \ > 0, for all n>v. So, for n > v : 

1 1 1 n 

~E W ri i = ~E VF„ 4 + -^(crj - stj+i) -)• 6- sa a.s., (13) 



n * — ' n z — ' n 

i—l i—l j—i^ 



and (Tll"j) - (fT3")) lead to convergence a.s. in (|TU)) . Finally, since < W ns /n < Wi s /n + Y^j=l °~jl n an d since 



random variables X^j=i a j/ n are uniformly integrable, convergence in mean also follows. □ 

Lemma 4.3 Assume b > (s — l)a. For any e > 0, i/iere exisi A < oo and an integer d > 1 smc/i faai, /or 
any initial value Wi roitt Wi s > A, 

+ . . . + VFi +d , s - Wn - . . . - Wi s } < d(b - sa + e). 

Proof. By property (2) of Lemma I4TT1 it is enough to prove the result for initial value Wn = . . . = 
WV M = 0, W sl = A only. 

Choose C such that Emin(r, C) > a — e/2. By property (1) of Lemma \4. 11 we may prove the lemma 
with interarrival times min(rj , C) in place of Tj . 



Consider an auxiliary unstable GI /GI /(s — 1) queue W„ with initial zero value and, by applying the 
evious lemma, find d such that E Wi+<M - 

queue and take A = (d + 1)C. We will prove that 



previous lemma, find d such that Wi+<M — ^(^ — ( s — l) a + e /2)- Then return to the s-server 



^Wi+d.i = ^W ? i + d, 1 + ^-^ min ( r J' C ') a - s -> ( 14 ) 

z— 1 i—l 2=1 

then the result will follow. 

Consider vectors V„ and numbers i n as in the Introduction, with initial values Vi.i = . . . — Vi, s _i = 
and Vi tS = A. Note that V n , s > A - (n - l)C > 0, for all n = 1, 2, . . . , d+ 1. 

Let n = min(d + 1, min{n > 1 : i n = s}). Then R(V Uj i,. . . , V^, s _i) = (W M ,i . . . , W M , s -i) and 

s s s — 1 s — 1 /i— 1 

E = E = E + f/M = E + A - E minCr,-, C). (15) 

i—l i—l i—l i—l j— 1 
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This ends the proof of flU) if fx = d + 1. 

In the case p < d + 1 , we may conclude that 

< A - (fi — 1)C < V^ s = 
and, therefore, W n ,i > and W n ,i > 0, for all p, < n < d + 1 and i = 1, . . . , s. Then, from (|15p . 

XX<i+M = ^W^+^CTj -Slllill^C)) 
4—1 i= 1 i— M 

s — 1 d d 

= + - - 1) minfo, C)) + A - ^ min(r J , C) 

i=l j=l 

which coincides again with the right side of ([T4"]) . 



□ 



5. Lower Bound. The following result holds without any restrictions on the service time distribu- 
tion B (a similar result was formulated and proved in |17l Theorem 3.1]). 

Theorem 5.1 Let k G {0, 1, . . . , s — 1} be such that p > k. Then, for any fixed S > 0, 

nD> X }> pS ~ k + ,f ] B- r s - k (^- X ) as x^oo. 
(s — fc)! \p — k J 

Proof. We exploit the technique of s — k big jumps. Following Corollary 12. 1[ we consider only 
deterministic interarrival times, r = a. 

The case k — was considered in Lemma |3~T1 So now let fc > 1. Let W„ = (W n i, • ■ • , W nk ) be the 
residual workload vector in the GI /GI /fc system with the same interarrival and service times as in the 
original system, and with k servers. Since p > k, the fc-server system is unstable. Hence, by Lemma 
14.21 both the minimal coordinate W n \ and the maximal coordinate W nk drift to infinity as n — > oo with 
probability 1, with the same rate (b — ka)/k. Then 

™ f~ /b — ka \ — (b — ka \ 

PjWvi >N[ — 6), W ik <N(—— + 6) 



5 for alH < N > -)■ 1 as N oo. 



If we assume that there are initially big workloads at s — k servers while the k other queues are empty, 
then, with high probability, the k smallest workloads evolve like the fc-server system with workloads W n , 
for a long while. This observation implies that 

F{W N1 > N{^—^ - 5) , W ik < N{^—^ + S) , Wi, k+ i > N^—^ + s) for alH < N 

Wife = 0, W hk+ i > N^—^ + &)+ Na} 

Take c such that 

b — ka „ . ,.. M fb — ka 
~~k 

for all sufficiently small S > 0, and let 

'b — ka 



1 as N — > oo. 



+ S < (1 + C £)(^— ^-5) (16) 



Then 

F{D N >x | Wife =0,Wi, fe+ i >x(l + cS) + Na} 1 as x oo. 

By the monotonicity of the s-server queueing system in its initial state (see Lemma l4.1[) . we obtain 

¥{D N > x | W hk +i > x(l + cS) + No] -> 1 asi^oo. (18) 

For i = (ii, . . . , i s —k), 1 < ii < . . . < i s — k < n i define the events A n (i) as 

An(i) = {a tl > y + (n - i x )o, . . . , cr is _ fc > y + (n - i s - k )a}. 
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Again like in (JT]) we have 

p{ u A ^)} > (i-o(i)) E nMm 

i:i s -k<n—N i:i,g_fe<n— N 

as y — > oo, uniformly in n and N. We prove now that 

lim V P{A n (i)} > ^l^B~ r S ~\y+(N + S -k)a). 



(s - k) 



(19) 



(20) 



i:i s _ fc <ri-A r 

Indeed, by the independence of the cr's, 

E p {A»(i)} = E S(tf+(n-*i)a)-..--5(y+(n-*,_ fc )a) 

i:i s _k<n — N i:z s _^<n — iV 

= E B(y + iia) ■ . . . ■ B(y + i s - k a)- 

JV<ii<...<i s _fc<n-l 

Hence, the left side of (|20|) equals 

E S(y + iia)-...-S(y + i s _ fe a) > E B(y + Na + ha) ■ . . . -B(y + Na + i s - k a) 

N<i!<...<i a - k l<ii<...<i s _ fc 

By Lemma \'S . 2 1 with qi = B(y + Na + ia), the sum on the right is not less than 

1 



(s-k) 



E B{y + Na + ja) 

j=s-k 



s-fe 



Since the tail probability is non-increasing, 



00 1 Z* 00 

E + Na + ja) > - / 2% + + z)dz. 



j=s—k 

Combining these expressions, we obtain the desired estimate (|2T))) . Substituting (I2TJ1) into (fH?)) we get, as 
y -> oo, 

lim P{ (J > /; 

<n — N 



(s - k)\ 



B r (y + (N + s - k)a). 



(21) 



Let ?/ = x(l + c5) in the definition of A n (i). Since an increment per unit of time of every coordinate of 
the workload vector W, is not less than —a, on the event A n (i) we have Wj tk +i > x(l + c8) + (n — j)a, for 
all j £ [i a —k + 1) n]. Consider i such that i s - k < n — N. Then A n (i) implies W n -M, k +i > x{l + cS) + Na. 
Together with flTHJ| it yields 

p{D n > x 

i:i s — k <n — N 

as x — >■ oo, uniformly in n and N. Now it follows from fpT]) and ([22]) that 



U ^w} 1 



(22) 



P{I?>x;} > lantafp{w n i>x| |J A„(i)}p{ |J A„(i)} 



s—k 



> 



Thus, by dUD, 



P{£> > a;} > 



(s-fe)' 

p«- fc - ( l)_, , 
(s - fc)! 



i:? s _fc<n— iV i:i a _fc<n— iV 

(x(l + c<5) + (iV + s-fe)a). 



Hence, for every 6 > 0, 



P{D > a;} > 



The proof of Theorem 15. II is complete. 



^s—k 



( S - k) 



n 7T ( .'■( i 



b — ka — kS 

ka + S 
b — ka 



J + (s - fc)a) ■ 



S — 



o(l)_ s -fc/ 6 + 5 



(s-fc)! 



b — ka 



as x — > oo. 



□ 
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6. New Majorant. In the proof of the upper bound in Theorem 1 1.5 1 (see Section[3]), we introduced 
s parallel single server queues that provide a suitable majorant in the case p < 1 . If p > 1 then the single 
server system with service time distribution B is unstable and the above scheme does not work. For an 
arbitrary p, we need a more complex procedure to obtain a majorant. Hereinafter let k = [b/a] be the 
integer part of b/a. We continue to assume constant interarrival times t = a. 

Again let o~ n i, n > 1, i < s, be independent random variables with common distribution B. Define 
service times o~ n in the original D/GI/s system as in Section[3j Consider again s auxiliary single server 
queues D/GI/l, but now with different deterministic arrival times T n = n(k + l)(a — h) where 

* f b \ , b 

<h<a-- -, (23) 



fc+lv k + U k + 1 

and with service times equal to o~ n i in queue i — 1, 2, . . . , s. Then T\ = (k + l)(a — h) > b, so that the 
queues are stable. Let C7j be a stationary waiting time in the ith auxiliary queue. Since, for each n, 

the sequences {U n \,n > 1}, . . . , {U ns , n > 1} are mutually independent, (24) 

the limiting vector (Ui, . . . , U s ) consists of independent identically distributed coordinates too. 

In contrast to the case p < 1, it may not be true in general that, say, V n \ is smaller than U n \. 
Nevertheless, for p < k + 1, we can prove that, for any set I of k + 1 indices, ^2 ieI V n i < J2iei + r l I 
where r/j has a light-tailed distribution, this is Lemma 16.21 below. But first we state the main result of 
the Section which is an analogue of © for the general p. 

Lemma 6.1 There exists a number j3 > and a random variable n such that Ee /3l? < oo and, for all n, 
with probability 1, 

D n < U n ^ k+1) +n, 
where ?7 ni (fc+i) is the (k + l)th order statistic of vector (/7 n i, . . . , U ns ). 

Now we formulate and prove the following result. Based on it, we give the proof of Lemma |6. II at the 
end of the section. 

Lemma 6.2 There exists (3 > such that, for any set of k + 1 indices I — {i(l), . . . , i(k + 1)}, there is a 
random variable r\i such that Ke^ 1 < oo and, for any n, with probability 1, 

iei iei 

Proof. Fix some i' £ I. Consider an auxiliary GI/GI/k + 1 system = (V^ i7 i G /) with the 
same interarrival times equal to r„, but whose service times a' n are chosen in a special manner. At any 
time n, if i n 6 / (i n is defined in the proof of Theorem 11.51 see Section [3]) then put a' n — cr n j n and 
i' n = i n . If i n ^ I then put o~[ n = o~ n %i and i' n — i' . Applying property (1) of Lemma FL"T1 we get that 
R{V n i,i G J) < RV' n coordinatewise, for any n. Therefore, 

< E^, 

iei iei 



Hence, it suffices to prove that 



E^ < E C7 ~+^- ( 25 ) 



iei iei 



For every i € I and for any n, 

U n +i,i-U ni > a ni -(k + l)(a-h), 

and hence 

E^+M-E 17 ™ - v' n -(k + l)(a-h)+ (o- in -(k + l)(a-h)) 

iei iei iei,i=£i' n 

= <7;-(fc + l)a + C/,n, (26) 
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where the independent identically distributed random variables 

Cl,n'= J2 &n-b) + (k + l) 2 h + k(b-{k + l)a) 

iei ,i^i' n 

have a positive mean, by the left inequality in (1231) . 

Take e 6 (0,E£/ ifl ). Let d and A be defined by Lemma POl applied to the system (V[ +ni ,i 6 I). 
Consider d-skeleton of V, that is, the sequence V' 1+nd . For every n, if the maximal coordinate of 
(V{ +nd ;,!£/) is not bigger than A, then 

^ V{+nd+d,i ~ Vt+nd,« — "nd+l + • • • + 0"nd+dj 
iei iei 

which together with (|2T))) implies that 

^ ^l+nd+d,* _ X! ^l+nd,i - X! U l+™d+d,i ~ ^ U 1+nd ,i + d(k + i)d - Cl,l+nd - • ■ ■ - Cl,nd+d 

iei iei iei iei 

< ^2 U 1+nd +d,i - ^2 Ui +nd . t + d((k + l)a + b), 
iei iei 

since > —b. To conclude, if the maximal coordinate of (V-[ +nd is not bigger than A, then 

< (k + l)A, 

iei 

so that 



E^i'+„d+cM < ^2u l+nd+dti + d((k + l)a + b) + (k + l)A 

iei iei 

'■= /] U\+nd+d,i + C, (27) 

iei 

Further, if the maximal coordinate of (V( +nd 4 , i G 7) is bigger than ^4, then, by Lemma 14.31 we have 

^l+wd+d,i ~ E V(+nd,i ^ 6l,l+nd, 

iei iei 

where Oj i +n d are independent identically distributed random variables with mean E^/.i+nd < d(b — (k + 
l)a + e) and such that 

Ol,l+nd < v'nd+l + ■ ■ ■ + a nd+d- 

In this case, by (f26|) . 

^ V l+nd+d,i - X] V l+nd,i < ^ Ul+nd+d,i ~ ^ ^l+rad,i + Ol,l+nd - W n d + ■ • • + ^nd+d) 

ie/ iei ie/ iei 

+<2(fc + l)a - Cl,l+nd - ••• - Ql,nd+d 
'■= ^Pl+mi+d,! — X £7l+nd,i + ^/,1+nd- (28) 

Inequalities (|27|) and (f28| imply that always 

n 

X ^/+nd+d,i < X U i+nd+d,i + C + max X (29) 
iei iei 3=0 

Here #/,i+nd, n = 1, 2, . . . are independent identically distributed random variables that are bounded from 
above and have a negative mean. Indeed, 

dl,l+nd = dl.l+nd - (Cnd+l + • ■ • + c'nd+d) + + !) a _ ,l+nd ~ ■ ■ ■ ~ C,I,nd+d 

< d(k + l)a - 0,1+nd - ... - (l,nd+d 

< d((k+l)a + b) 
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and 

E0r,i+nd = E6i t i +nd -bd + d(k + l)a- dE(i t i + nd 

< d(b -(k+ l)a + e) -bd + d(k + l)a - dEQ A+nd 
= d(e - EC/,i+„d) < 0, 

by the choice of e. Therefore, there exists (3 > such that Ee /3e - r > 1 +™ d < 1 and then the following estimate 
holds: 

n 

Eexp{/3max^^j,i +jd } < ^(Ee ,3e ^ 1 +" d )" < oo. 
J=0 n 

Let 

n 

rji := C + m&x} 6i t i + j d , 

n * — ' 

3=0 

then Ke^ 1 < oo and, by the upper bound (|29[) . for all n, 

J^Vl+nd+d.i < ^Ul+nd+d.i+m- (30) 

iei iei 
Since, in addition, for every I 6 [l,d], 

X] V(+nd+d+l,i ~ 22 ^l+nd+d+l-l,i - 2^ Ui+ n d+d+l,i - ^ Ui +n d+d+l-l,i + (k + l)a, 
iei iei iei iei 

we conclude from (f3"P)) that, for every I <G 

X] V l+nd+d+l,i < ^2Ui +nd +d+l,i + rji + l(k + l)a, 
iei iei 

so that, for every n, 

iei iei 

which completes the proof of Lemma 16.21 with rjj := rji + d(k + l)a. □ 
Proof of Lemma 16. 11 For every collection I of k + 1 coordinates 

A. < ^E^-. 

since D n is the minimal coordinate. Then it follows from Lemma 16.21 that 

D n < -—.y^Uni + Vl- (31) 



Take 77 := max 77/. Then Ee' 3 *' < 00 and 

7:|/|=fc+l 



^ T E f/ ™ + ? '' ( 32 ) 



iei 

Take J such that {U n i,i € /} are the fe + 1 smallest coordinates of vector (f/ n i, . . . , f/„ s ). Then f7„j < 
^n,(fe+i) f° r every i € I. Together with (|3"2"|) it yields the inequality of the lemma. □ 

7. Upper Bound and the Principle of s — k Big Jumps. Now we turn to the upper bound. 
Lemma 16 . 1 1 allows to prove the following general result. 

Theorem 7.1 Let p < k + 1 for some k € {0, 1, . . . , s — 1}. Then, for any fixed h satisfying (|23|) . there 
exists (3 > such that 

P{D > x + y} < f * ) (F(x)) s ~ fe + const ■ e'^ for all x, y > 0, 

where F is the distribution of random variable 



n 

M := sup(0, ^(o-j - (Jfe + l)(a - ft)), n > 1 
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Proof. First, by inequality b = Ecr < [k + l)(a — h) and by the strong law of large numbers, the 
maximum M is finite with probability 1. By Lemma |6.1[ 



P{D n >x + y} < P{tf„, (fc +i) + 7} > x + y} 

< nUn^k+i) >x}+P{n>y}. 
Taking into account the independence of the U's in (j2"4")l . we obtain 

P{D n >x + y} < ( * )p s - k {U nl >x}+P{n>y}. 

Letting n — > oo and taking into account the duality between the single server system and the maximum 
of the corresponding random walk, we arrive at the following inequality: 

P{D>x + y} < ( * y~F(x)) s - k +P{r 1 >y}. (33) 

Since rj has a finite exponential moment, we obtain the statement of the theorem. □ 
Proof of the upper bound in Theorem LL61 It follows from Theorem I7JJ that 



»{D>x} < ( * )f s k {x{l -&)) + const ■ e-P 5x . 



Due to the subexponentiality of B r we obtain from the analogue of ^ for the maximum of a random 
walk (see, e.g., [TDJ Theorem 5.2]) that, as x —> oo, 

Taking h in (f2"3")) close to its minimal value, say h = (^a — jrfjj + e, e > 0, we arrive at the following 
estimate: 

— \ ^ — / \ (fc + l)p — 

{X > ~ a-b/(k + l)-(k+l)e r{X > = k + l-p-(k + l)2e/a Br{x) - 

In addition, B r (x(l — 5)) ■ e l3Sx —> oo as x — > oo. All these facts and arbitrarity of choice of e > imply 
the desired bound. □ 

It what follows, for two families of events A x and B x of positive probabilities indexed by x, we write 
A x - B x if P{A X \ B x } = o(P{A x }) and P{B X \ A x } = o(P{A x }) as x -> oo. Note that A x - B x implies 
P{-4a:} ~ ^{B x }, but not vice versa. 

We establish now the principle of s — k big jumps in the case of intermediate regularly varying distribu- 
tions. For simplicity, we do it again for D/GI/s system with deterministic inter-arrival times. For this, 
we consider the representation of the stationary workload in the backward time (the so-called "Loynes 
scheme"). We again use the joint representation of s individual queues and of the s-server system given 
in the previous section and assume that all queues run for a long time, from time — oo, and that Ui is the 
stationary waiting time of the customer that arrives at the zth queue at time 0. Then 

Ui = SUp(0, £_ M , £_ M + £-2,1, + ■ • • + £-n,ij • ■ •) 

where = Uj^ — a, for i = 1, . . . , s and j = —1, —2, . . ., and a = (k + l)(a — h). Further, W„ are 
stationary vectors for n < 0, and 

W n+1 = R((W nl +a n ~ a)+, (W n2 - a)+ . . . , (W„, s - o)+), 

for all n < 0. Here again i n = min{i : V n i — D n } and <r n = cr n ,i n - Then, for any x > 0, by Lemma l6.1i 

{D > x} C U{mmf7i + rj > x} 

J ie 

where Dq is the stationary waiting time in the D/GI/s queue, i.e. the minimal coordinate of vector 
Wo, J's are subsets of {1,2,..., s} of cardinality s — k, and n is a random variable with light-tailed 
distribution. Then 

{Dq > x} — I \{Dq > x, min Ui + rj > x}. 
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Assume that the residual distribution function B r of service times is intermediate regularly varying 
(for that, it is sufficient for B to be intermediate varying). Then, clearly, each random variable Ui has an 
intermediate regularly varying distribution since P(£/$ > x) ~ cB r (x). Since the random variables Ui are 
mutually independent, the distribution of mm^j Ui is also intermediate regularly varying, ¥ (mm Ui > 
x)~c s - k (B r (x)) S ~ k . 

It is well- known, see e.g. [TUJ Ch 5], that 

{Ui > x} ~ [J {a- n ,i > x + na} 

71>1 

and therefore, for any set J C {1, 2, ... , s}, 

{min Ui > x} ~ Q I (J {<7_„,; > x + na} . 

iEJ \n>0 / 

We use the following property of intermediate regularly varying distributions (its proof is postponed 
until the end of the section; a similar result for equivalence of probabilities may be found in [2]): 

Lemma 7.1 If X and Y are two random variables such that X has an intermediate regularly varying 
distribution and P{|Y"| > x} = o(¥{X > x}) as x — > oo, then {X + Y > x} ~ {X > x}, for any joint 
distribution of X andY. 



Applying Lemma 17. II with X — min J6 j Ui and Y = 77, for all J of cardinality s — k, we get 
{D > x} — I \{D > x,mmUi > x} 

^ iEJ 



u n u { d ° > x ' a ~ n ' i > x + n ®} ' 

J iEJ \n>0 / 



since the upper and the lower bounds for F{Dq > x} are of the same order, see [3l Theorem 7] or [9] for 
further arguments. Now represent any event on the right in the latter equation as a union of two events 

{Do > x, a- n> i > x + na, i- n = i} U {Dq > x, 0- n .i > x + na, i_ n ^ i} 

where 

P{Z?o > x, o-- n ,i > x + na, i-„ ^ i} = P{-Do > x, i- n ^ i}¥{a- n> i > x + na} 

< P{Do > x}¥{a- nti > x + na}. 

So, for any set J, the union of events 



Pi I U { D ° > X > (7 - n ' i > X + 7^ i-n} I 

iEJ \n>0 / 



has probability 0(¥{Do > x}B r (x)) = o(P{Do > x}). Since there is only a finite number of sets J, we 
obtain the following result. 

Theorem 7.2 Assume that p 6 (k,k + 1) and that the distribution of service times is intermediate 
regularly varying. As x — > 00, 

s — k 

P{D > x} ~ Pj^o > x, (J f]W-n 3 >x + nj a}y (34) 

0<n 1 <n 2 <---<™a-fc j'=l 



Remark. In the proof of Theorem 1 7. 21 we followed the scheme introduced in [3], see also [3], [I], and 
[5] for similar constructions. Theorem 17.21 is not the final statement. We may go further and obtain the 
following result. Assume that B is a regularly varying distribution. Then, for some positive and finite 
constant C and as x — > 00, 

¥{D > x} - CB s ~ k (x). (35) 
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The result seems to be correct, but its prool would be very lengthy and would require a scrupulous 
calculation, so we decided not to proceed lurthcr in this direction. 

We provide a hint for a plausible proof instead. First, one may consider an auxiliary deterministic model 
with (n — s) very big service times y\, . . . , y s -k that occur at time instants — n\ > —n^ > . . . > — n s -k 
and replace all other service times by their mean b. We also assume that, before the first jump, the 
workload vector is zero. For this model, we may find conditions on the y's for the minimal coordinate 
of the workload vector at time to be not smaller than x. Then repeat the same for all the other times 
of jumps — ni > —ri2 > ... > —n s -k- The union of these regions may be represented as a combination 
of unions and differences of a finite number of truncated half-spaces of dimension s — k. Summation of 
tail probabilities over each such set gives the probability of order B r (x), thanks to the properties of 
regularly varying functions. So a finite combination of sums and differences of these probabilities gives a 
probability of the same order. It cannot be of a lower order, due to the lower bound. 

Proof of Lemma 17.11 From Theorem 2.47 in [TO], if X has an intermediate regularly varying 
distribution, then 

¥{X >x + h(x)} ~ ¥{X > x} ~ ¥{X > x - h(x)} 

as x — > co, for any function hix) — > oo such that h(x) — o{x). Hence, by the monotonicity arguments, 

{X > x + h(x)} ~{X>x}~{X>x- h(x)}. 

Since the distribution of X is intermediate regularly varying and since P{|Y > x} = o(P{X > x}) as 
x — > oo, we have P{|Yj > ex} = o(P{X > x}) as x — > oo, for every e > 0. Then there exists h(x) = o(x) 
such that 

P{|Y| > h(x)} = o(¥{X > x}). 

Therefore, as x — > oo, 

{X>x} - {X > x + h(x)}\{Y < -h(x)} 

= {X > x + h(x),Y > —h(x)} C {X + Y > x} 

and 

{X>x} - {X > x - h(x)}U{Y > h(x)} D {X + Y > x}, 
which justifies the events equivalence, {X + Y > x] ~ {X > x}. □ 

8. Existence of moments: proof of Theorem 4. Since the tail distribution of 
min(0v.i, . . . , <J r ,s~k) is equal to (B r (x)) s ~ k , we obtain from Theorem 15.11 

P{D > x}> ciP{min(CT r ,i,...,cr^ s _ fc ) > c 2 x}. 

Since, for any non-negative random variable 77, 

/>oo 

E?? 7 = 7 / x 7 " 1 P{?7 > x}dx, 
Jo 

we have 

ED 7 > -E(mm(a rA ,...,a r , s - k ))i. 

C2 

and the existence of the moment of order 7 for the delay D implies with necessity 

Now assume Consider s—k independent copies M\, . . . , M s _fc of the random variable M introduced 
in Theorem 17. II Then the assertion of Theorem 17. II can be rewritten in the following way: 

¥{D > x + y} < ( S k )p{min(Mi, . . . , M s - k ) > x} + const ■ e'^. 

Take y = x. Then EZ3 7 < 00 follows if we prove that 

E(min(M 1 , . . . , M s _ fe )p < 00. (36) 

In order to do it, we explore the ladder height construction for the maximum M of a random walk 
S n = X\ + . . . + X n where Xj = <jj — b — e. Since this random walk has a negative drift, the first ladder 
epoch and the first ladder height 

6 = mm(n > 1 : S n > 0), x = Sg, 
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both are degenerate random variables; 

p = F{6 < 00} = P{M > 0} < 1. 
Denote by \ a random variable with distribution 

P{x eB} = ¥{x e 

Let Xj be independent copies of x- If 7? is an independent counting random variable with distribution 
F{rj = j} = (1 — p)p J , j = 0, 1, . . . , then M is equal in distribution to xi + • • ■ + Xj?- 

Let Xij be again independent copies of \ and 77^ be independent copies of rj. Then min(Mi, . . . , Af s _fe) 
is equal in distribution to 



1/1 'Is — K \ 



\j = l J = l 

The latter minimum does not exceed 

Y min (Xl,Jl>---)X S -fe,ia-J- 

Taking into account that for non-negative arguments 

( Xl + ... + x N y <N~t(xJ + ... + xl), 

we get the following estimate: 

, 1)1 Vs-k s 7 1)1 Vs-k 

min [Yxi,j,---, Y Xs-kA < (m + ■ ■ ■ + Vs-k) 1 Y ■ ■ ■ Y m[n (xi,j 1 ,---,Xs-k,j s _ k V- 

S=i j=i ' ii=i j s - k =i 

In particular, the mean of the term in the left side of the equality above is not larger than 

00 00 

■ ■ ■ Y - py i+ - +i -* (31 + ..- + js-kVh ■■■■■ Js-kE min(xi,i, ■ • ■ , Xs-m) 7 

= E(?7i + . . . + ?7 s -fc) 7r /i • ■ .T7 s -feIEmin(xi,i, ■ ■ ■ ,Xs-fc,i) 7 - 

Since the r/'s have finite exponential moments, the first mean on the right is finite. Now we show finiteness 
of the second mean. First, 

F{ X >x}= f B(x-y)fx(dy), 
J — 00 

where the measure /1 is defined by 

fj,(dy) = F { Sn E d y> Sk - for a11 fc < « - !} 

n 

< ^2¥{S n edy}. 

n 

Then, by the key renewal theorem, 

c = sup// (y - 1,2/] < 00, 

2/<0 

which yields 

00 

P{X > x} < c^2B(x+j) < cB r (x - 1). 
j=o 

Therefore, due to condition (J4j) , 

Emin(xi,i, . . . ,Xs-m) 7 < 00, 

which completes the proof. 
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